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A Reliability of Measurement Based Algorithm for 
Adaptive Estimation in Sensor Networks 

Wael M. Bazzi, Amir Rastegarnia and Azam Khalili 


Abstract — In this paper we consider the issue of reliahility 
of measurements in distributed adaptive estimation problem. To 
this aim, we assume a sensor network with different observation 
noise variance among the sensors and propose new estimation 
method based on incremental distributed least mean-square 
(IDLMS) algorithm. The proposed method contains two phases: 
I) Estimation of each sensors observation noise variance, and 11) 
Estimation of the desired parameter using the estimated observa¬ 
tion variances. To deal with the reliability of measurements, in the 
second phase of the proposed algorithm, the step-size parameter 
is adjusted for each sensor according to its observation noise 
variance. As our simulation results show, the proposed algorithm 
considerably improves the performance of the IDLMS algorithm 
in the same condition. 

Index Terms — adaptive filter, distributed estimation, sensor 
network, IDLMS algorithm. 

I. Introduction 

C ONSIDER a wireless sensor network composed of dis¬ 
tributed sensor nodes as shown in Fig. 1. The purpose 
is to estimate an unknown vector w° from multiple spatially 
independent but possibly time-correlated measurements col¬ 
lected at N nodes in a network. Each node k has access 
to time-realizations {dk{i),Uk.i} of zero-mean spatial data 
{dk,Uk} where each dk is a scalar measurement and each 
rtfc is a 1 X M row regression vector. We assume that the 
unknown vector relates to the as: 

dkii) = Uk,iW°+Vk{i), (1) 

where Vk{i) is observation noise with variance ^ and is 
independent of {dk{i),Uk,i}- A number of studies have consid¬ 
ered such a distributed estimation problem 111-|[^. In Q-||T^ 
distributed adaptive estimation algorithms using incremental 
optimization techniques are developed and their transient 
and steady-state performance analysis are also provided. The 
IDLMS and distributed recursive least mean-square (DRLS) 
Q are the examples of such algorithms. These algorithms 
are distributed, cooperative, and able to respond in real time 
to changes in the environment. In these algorithms, each 
node is allowed to communicate with its immediate neigh¬ 
bor in order to exploit the spatial dimension while limiting 
the communications burden at the same time. In IH-ID, 
diffusion implementation of distributed adaptive estimation 
algorithms are developed. In these algorithms, each node can 
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Fig. 1. A distributed network with N sensor nodes. 

communicate with all its neighbors as dictated by the network 
topology. Both LMS-based and RLS-based diffusion algo¬ 
rithms are given in the literature. In addition, for both of these 
cases the performance analysis can be found in |[^ and 0 
respectively. In comparison with incremental based algorithms, 
dijfusion based methods need more communication resources 
while have better estimation performance. Both diffusion LMS 
and diffusion RES algorithm are introduced in the literature. 

In all of the mentioned distributed adaptive estimation 
algorithms, either equal observation noise is assumed for 
all the nodes in the network or same strategy is used for 
different variance condition. The motivation for a new esti¬ 
mation method stems from the following facts: 1) The equal 
observation noise variance is not a suitable assumption in 
practice, and 2) It is clear that if the issue of reliability 
of observations is considered, better estimation performance 
can be expected. In this paper, to deal with the mentioned 
problems and especially the issue of reliability of observations, 
we propose a new distributed adaptive estimation algorithm. 
In the proposed method which is based on IDLMS, first each 
sensor’s observation noise variance is estimated and in the next 
step, based on the estimated variances, the step-size parameter 
is adjusted according to estimated observation noise variances. 

II. Estimation Problem And The Adaptive 
Distributed Solution 

A. Notation and Assumptions 

A list of the symbols used through the paper, for ease of 
reference, are shown in Table I. 

The subsequent equations rely on the following assumptions 

• Uk,i is independent of u/^ for k ^ I, (spatial indepen¬ 
dence). 

• For every k, the sequence Uk,i is independent over time 
(time independence). 

• The variances of observation noise for all of the sensors 
do not vary with time. 
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TABLE I 

List of the Main LFsed Symbols 


Symbol 

Description 

Wi 

Weight vector estimate at iteration i 

Ui 

Regressor vector at iteration i 

e{i) 

Output estimation at iteration i 

d(i) 

Value of a scalar variable d at iteration i 

Ui 

Value of a vector variable u at iteration i 


B. problem Statement 

By collecting regression and measurement data into global 
matrices results (see 1); 


U = col {ui,U 2 , 

...,Un} 

(2) 

d = col {di, d 2 ,. 

.., djif} 

(3) 


where the notation col {•} denotes a column vector (or matrix) 
with the specified entries stacked on top of each other. The 
objective is to estimate the vector that solves 

min J(?ii) where J(w) = E\\d— Uw\\^ (4) 

W 

The optimal solution satisfies the normal equations Q 

Rdu = RuW° (5) 

where 

N 

Rdu = E{U*d} = Y,Rdu,k, (6) 

k^l 

N 

Ruu=E{U*U} = Y,Rn,k- (7) 

k=l 

where in (6), the symbol * denotes the Hermitian transform. 
Note that in order to use (5) to compute w° each node must 
have access to the global statistical information {Ru,Rdu} 
which in turn requires more communications between nodes 
and computational resources. 


C. Incremental LMS solution 

The standard gradient-descent implementation to solve the 
normal equation (5) is as 

Wi = Wi-i + p[V J {wi-i)]* , (8) 

where /i is a suitably chosen step-size parameter, Wi is an 
estimate for desired parameter (i.e. Wo) in fth iteration of 
VJ(-) and denotes the gradient vector of J{w) evaluated at 
Wi-i . If /i is sufficiently small then Wi ^ w° as i ^ oo 
©-©. In order to obtain a distributed version of (8), first the 
cost function J{w) is decomposed as 

N 

J{w)=^Jk{w), (9) 


where 


Jk = E {\dk - Ukwl'^Y 


( 10 ) 


Using (9) and (10) the standard gradient-descent implementa¬ 
tion of (8) can be rewritten as [3-6]: 


Wi = w^-i - p. 


N 


'^VJk {Wi-i) 


.k=l 


( 11 ) 


ii) 

By defining the as the local estimate of the at node k and 
time i, then Wi can be evaluated as 


- d [V Jfe («;*-!)]* , k = 1 , 2 ,..., N (12) 

This scheme still requires all node to share global information 
Wi-i. The fully distributed solution can be achieved by using 
the local estimate at each node k instead of Wi-i, 


/,(* 


- d [V Jfc 


fc = l,2,...,iV (13) 


Now, we need to determine the gradient of J and replace it 
in (13). To do this, the following approximations are used 


Rdu,k ^ 

- dk{i)ul i 

(14) 


« U*k,^Uk,^ 

(15) 


The resulting IDLMS algorithm is as follows 


/ (i) 

% ^ Wi-i 

= V’i-1 


fc=l,2, 


,N 


dk{i) - Uk,t'ipkli 


(16) 


I (i) 

Wi ^ 


III. Proposed Algorithm 


A. Motivation 


As mentioned in the introduction section, equal observa¬ 
tion noise assumption for all nodes could not comply with 
situations in physical problems. On the other hand, although 
considering some noisy sensors in the network (as in pO) ) 
is a better assumption for sensor network, but it is still far 
away from real scenario. Nevertheless, the results obtained in 


1201 reveal that considering the sensors with high observation 


noise will cause severe decrease in performance of the dis¬ 
tributed adaptive estimation algorithms such as IDLMS. To 
address this problem and to deal with the issue of reliability 
measurements, a new adaptive distributed estimation algorithm 
where each sensor participates in the algorithm according to 
its observation noise variance is proposed. 


B. Method 

To deal with the mentioned conditions, it is necessary to 
obtain an estimate of each sensor’s observation noise. To 
do this, we consider the equation (1) again. If the IDLMS 
algorithm (i.e. (16)) is done for Ls times (where Ls is a 
suitably chosen integer), it is possible to have a primary 
estimate of w°. Now this primary estimate of w° is used to 
obtain each sensors observation noise. It must be noted that 
this estimate of w° is used just to obtain a primary estimate 
of observation noise at each sensor, and it is not the final 
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(Ls) 

estimate of w°. Denoting by '0^ ^ as the estimate of w° in 
the *th iteration in A^th node we will have; 


0 


(Ls) 

N 




k—N, i—Ls 


(17) 


Using (1) and (17), the observation noise at each sensor can 
be estimated as 


nk{i) = dk{i) - i = l,2, ...,Ls (18) 

In each node k, first the nk{i) is computed and then the 
variance of observation noise of the A:th sensor is estimated 
by 


9k =(^) 

Ls 

'^nk{i). 

(19) 

Ls 



CTfc = ^ (nfe(i) 

Z=1 

-9k)^ 

(20) 


As cTfc increases, the reliability of dk decreases, so there is 
inverse relation between dk and sensor’s reliability. Motivated 
by this fact we define the step-size of the our incremental 
distributed LMS algorithm as 


/ife = ftmaxe (21) 

where Pmax is the global step-size parameter (which is 
constant for all sensors) and a is a positive constant. It is 
obvious from the definition of (21) that larger observation 
noise variance (i.e. dk) yields smaller step-size parameter. 
Finally, for i > Ls -f 1 the IDLMS algorithm is modified 
as follows; 

^ = V'fc-i - Ffe [Rdu,k - Ru,kWi-i]* (22) 



Fig. 2. The MSD performance Proposed Algorithm with Ls = 10 and a=10 
in comparison with the IDLMS algorithm. 
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After i oo, all of the sensors will contain the appropriate 
estimate of w°, that is 

lim 0^*^ —>• u>°, k G {1,2, ■ ■ ■, N} (23) 


IV. Simulation Results 


In this section we present the simulation results of the 
proposed algorithm and compare it with the IDLSM algorithm 
of To this aim, we consider a network with N = 30 
nodes and Gaussian regressors with Ru,k — I- We further 
assume that crj G (l0“^,10“^). The curves are obtained 
by averaging over 100 experiments with /imax = 0.01 and 
M = 4. In Fig. 2, the performance of proposed algorithm for 
Ls = 20 and a = 10 in comparison with the IDLMS algorithm 
is depicted. To compare the performance of the mentioned 
algorithms we use the mean-square deviation (MSD) criteria 
which is defined as follows 


MSD = E 




(24) 


As it is clear from Fig. 2, the proposed algorithm has better 
performance in a sense of estimation performance. In Fig.3, 
the cr| and the corresponding step-size parameter for each 
sensor in plotted. 


Fig. 3. The (t| (up) and the corresponding step-size parameter for each 
sensor (down). 


The performance of the proposed algorithm depends on the 
value of Ls, since it determines how 0^ is close to w°. In 
Fig. 4 the performance of the proposed algorithm for different 
values of Ls in comparison with the IDLMS algorithm is 
shown. As it is clear from Fig. 4, as Ls increases, better 
primary estimate of w° is obtained and as a result, a better 
final estimate of w° can be expected. It must be noticed that 
when the algorithm is in its steady-state, increasing the Ls 
can not provide more better primary estimate of w°. On the 
other hand, by choosing the Ls such that the algorithm is 
not in its steady-state, the resulted 0^ ^ is not close enough 
to w° which in turn makes a dramatically decrease in the 
performance of the proposed algorithm. These cases can be 
easily concluded from the Fig. 5 where the MSD performance 
of proposed algorithm for different values of Ls is plotted. 

The performance of the proposed algorithm also depends 
on the a parameter, (see (21)). By increasing a ,the assigned 
step-size parameters become more smaller and as a result, the 
proposed algorithms provides better estimation performance 
(lower MSD) while, on the other hand, the convergence rate 
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Fig. 4. The performance of the proposed algorithm for a = 10 and different 
values of Ls in comparison with the IDLMS algorithm. 



Fig. 6. The performance of the proposed algorithm for a = 10, Ls = 20 and 
different number of sensors, i.e. K, in comparison with the IDLMS algorithm. 


of proposed algorithm decreases. In Fig. 5 the performance of 
the proposed algorithm for different values of a in comparison 
with the IDLMS algorithm is shown. In the proposed algorithm 



Fig. 5. The performance of the proposed algorithm for Ls = 20 and different 
values of a in compaiison with the IDLMS algorithm. 


by increasing the number of sensors in the network, the 
convergence rate of the algorithm decreases without change in 
the steady-state error which is the case for IDLMS algorithm. 
In Fig. 6 the performance of the proposed algorithm for 
different number of sensors,iL and a = 10 and Ls = 20 
in comparison with the IDLMS algorithm is plotted. 

V. Conclusion 

In this paper we considered the issue of reliability of 
measurements in distributed adaptive estimation algorithms. 
To deal with this issue we proposed a distributed adaptive 
estimation method based on IDLMS algorithm. The proposed 
algorithm contains two different phases; I) Estimating each 


sensor’s observation noise and II) Estimating unknown pa¬ 
rameter using the estimated observation noise variances. Also 
In this paper the step-size parameter is assigned to each 
sensor according to its observation noise variance. As the 
simulation results show, the proposed method outperforms the 
IDLMS algorithm in the sense of estimation error under the 
same conditions. It also must be noticed that although in this 
paper we consider the IDLMS algorithm as the base for our 
estimation method, the proposed method can be used in other 
adaptive estimation algorithm like diffusion least-mean square 
algorithm and DRLS as we did respectively in |211. 
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